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ABSTRACT 

An investigation of how some school districts 
construct and maintain needed links between evaluation/testing and 
curricular/instructional activities is presented. Researchers must 
build on the twin strands of research about school and school 
district organization and developments in testing, evaluation 
methodology. School district characteristics which might inhibit data 
use include loose organizational coupling, teacher isolation, 
permeable organizational boundaries and goal ambiguity. Using , 
information from previous ^studies*, four School districts which link 
evaluation and instruction were selected 'for intensive study. 
Specific information about one of the four school districts is 
presented in this paper. This case study is used to demonstrate that 
the elements of ideas, operations and coordinating mechanisms are 
necessary for linking testing, evaluation and instruction subsystems. 
(CM) 
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Uses of Data to Improve Instruction in Local 
School Districts: Problems and Possibilities 



* » • 

• : 

The existence of test or evaluation data which .reveals students 1 
achievement in particular subject or skill areas does not, inevitably, 
lead to beneficial changes in classroom instruction and concomitant 

increases v in student learning. We have found that without competent and 

■*» ~ 
sustained attention by district management to comipum cation and support- 

ing services, the* use by principals and teachers of such data remains . 
problematic* We believe that the naturally occurring characteristics of 
school organization and classroom instruction impede such use. 

In this* -paper i we acknowledge that research on testing and evalu- 
ation has made great advances in* the past 15 years; and that other 
research on school and schopl district organization has contributed to 

F *• 

the field's understanding of how these institutions operate. We argue 
that researchers must now build on these twin strands. We report on our 
work which is an investigation gf how some school districts do, in prac- 
tice, construct and maintain the needed links between th6ir evaluation 
and testing activities on the one hand, and their curpcular 4nd instruc- 
tional activities on the other. 



Introduct ion * w . ^ 

~ r • • • • • 

'Since its inception in 1972, t.he National Institute of Education 
(NIE) has supported research related to educational evaluation. Some of 
this research has contributed to our understanding of the ways in which 
evaluation and tesing data can improve educational practice in American 
schools. From the research has emerged an ipripoKtant observation: the 
transformation of evaluation and testing results into improved school 
and classroom activities does not occur automatically. Instead, such 
transformation appears -to be a complex process influenced by many factors, 
includVfi£K^ specific individuals who aire expected to take action and 
the organizational settings within which they work. 

Two large groups of individuals Sre potential users of testing and 
evaluation findings. One such gr,pup is policy makers, external to a 
school ch" strict wha work within federal and state legislatures or 
agencies. Evaluatqrs expect that large-scale evaluations of federal v or 
state-funded educational programs can give policy makers at these levels 
sound information on which to base changes in local procram requirements, 
or to augment or cancel these programs. A second user group includes 
individuals internal to a school district: for example, board members* 1 , 
administrators, and classroom teachers. Evalu&tors expect that data 
collected about students can be of direct interest to within-district 
administrators and teachers who are responsible for fine-tuning their 
own curriculum and instructional programs. , 

At first gjance, it would seenr that the findings from any given 
program evaluation could be equally useful to both groups of people, 
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each of whom could make needed policy or program modifications at their 
own level of authority* Such appears not to be the case. Studies by 
Kennedy (1980)r, Alkin'et al. (1979), David (1978), Patton (1978), and 
Weiss (1972), have found that the users 1 own interests and organizational 
settings influence the reception they give to evaluation findings. A 
major implication of these studies is that evaluators or test givers who 

expect their findings to be utilized either by distant cpol icy makers or\ 

> 

by local educators must attend in advance to the specific interests of 
these individuals and to the constraints of their organizational settings. 

The Center for the Study of Evaluation (CSE), t? for the past five 

*> « 

years, has been conducting research on evaluation and testing as it 

| * 

•'occurs within school districts. Our intention in this paper is to 
describe school districts and the individuals who work^there so as to 
better understand why and how the findirf§s tfrom evaluation and testing 
activities are or are not linked to instructional decision-making at the 
school district. First, fwe will provide background information on the* 
growth of evaluation and testing; then we will make some observations on 
how the characteristics of school districts as organizations generally 
hamper the use of forms and evaluation. We will then describe our 
research strategy which investigates "heroic 11 school districts who are, 
in -fact,, using data for instructional decision making, offer one v example 
of such a district and then present several elements which seem neces- 
sary in order.for school districts to link evaluation and testing data 
with instruction. 
Background , 

The last 15 years have seen the growth of what might be called a 
testing and evaluation movement within American education. The seeds 
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for this development had been planted decades ago when psychological, 

intelligence, and aptitude tests to screen and o sort individuals were 
* ■ 

first developed -by the military and industry. School districts subse- 
quently followed suit. Many large school districts developed test 
bureaus which regularly collected and disseminated district-wide test 
results. „ 

These somewhat dormant testing seedlings experienced an enormous 
growth spurt and change' of direction when Congress passed the Elementary 
and Secondary Education Act in 1965. This Act required districts,, to . 
provide testing and evaluation data to government agencies a s a condi- 
tion for continuing funding. Subsequent federal and state legislation 
carried similar program evaluation conditions. This reporting require- 
ment shifted the focus of^testing from that of assessing individual 
student achievement to assessing the achievement of groups, of students 
in a -funded program. Instead of a counsellor looking at an individual's 
test score to assign that student to a special educational status, a 
funding agency would review the collectivity of scores to certify, 
modify, or eliminate an educational program. In short, large-scale 
testing of students had become one tool for generating data with which 
policy makers could identify, discourage, or further develop promising 
educationaKprograms and practices. 

The large-scale infusion of federal funds into educational evalu- 
ation since 1965 has had many additional reverberations. One important 
side effect of these funds is the flowering of what might be called a 
testing and evaluation "establishment 11 . Elements of this evaluation 
"establishment" extend to school districts and include: units within 
federal and state governments devoted to program evaluation and testing; 

u ■ y 
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university faculty and students engaged in courses and degree sequences 
in testing and evaluation; professional societies withjn education such^ 
as Division H of AERA, and across social action fields such as the 
Evaluation Research Society; a federally-funded Center for the Study of 
Evaluation. Inside school districts, the educational evaluation "estab- 
lishment 11 usually consists of those testing and evaluation personnel who 
face the task of carrying out required evaluation and testing .efforts. 
Centralized evaluation, units in, school districts have recently emerged, 
often composed o.f already employed guidance, testing, and counseling 
personnel. Within the last 10 years, over 400 districts have organize^ - 
their testing and evaluation capabilities into research-, development,' 
andevaluation (RD&E) t units which vary in size from one part-time person 
to dozens of professional employes (Lyon et-al., 1978). 

At first, academic members of 'the evaluation establishment outside 

0 

of the school districts largely concentrated their attention on the 

logic cfnd methodology of large-scale evaluations. A prime assumption 

upon which many operated, feven though that assumption was not always 

made explicit, was that federal and state policymakers were to be the 

prime consumers of their evaluation information; jschool district evalu- 

ators were expected to collect the data meticulously and accurately and 

.file reports. Explorations of the utilization of such data at the 

policy level (Boruch, 1980; Weiss, 1977) has made 1t increasingly clear 

that evaluation and testing reports as they are presently constituted 

do not have uniform and consistent influence on policy makers. Some 

t 

reports influence some policy makers upder some circumstances. At other 

^ j 

times, the reports are used selectively to provide corroborating ;evi- 
dence for policy makers to justify decisions that they had already 

# 
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made on some other basis. And iff still other instances, reports are 

ignored. * 

Concurrent with 'this' examination of evaluation utilization bv 

academics is interest by wi thin-district evaluators on the utilization 

£>f testing and evaluation information (Holley, 1979). As a result, we 

have begun to explore whether evaluation and testing originating as a 

means of satisfying the evaluation and dating concerns of external 

legislators and administrators, can also serve as^a basis for systematic 

and comprehensive local school district decisionmaking. 
9 

Jhe Center for the Study of Evaluation (CSE), established by, the 
same°1965 Act which attached evaluation^requirements to federally-funded 
programs, in its e f arly days worked pn the development of conceptual / * 
frameworks and technical solutions to problems* of evaluation. However, 
in recent years, in parallel- with the interest of the field, research 
projects have been started which are concerned with evaluation utiliza- 
tion both at the school-site' program administrator* level (Alkin et al., 
,1979; Daillak, 1980), and at the school-district central office organ- 
izational level (Lyon et.al., 1978). From these parallel studies of how 
evaluators relaje^to clients and of how research, development, ahd 
evaluation units handle their activities, it has become clear to us that 
although the potential does exist, local utilization of evaluation and 
testing does not occur routinely as a natural consequence of conducting 
an evaluation or administering a testing program. A special combination 
of environmental circumstances, competent and data-oriented people, and 
intentional organizational arrangements seem to be required to link data 
collection with reporting, dissemination, and support services so as to 
support instructional decisionmaking and classroom activities. 
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;* What are the characteristics of the environment, people, and organs- 

I P * - ^> % 

izational arrangements that ^result- in use of evaluation or testing data 

4 h * • 

for instructional improvement? 'One year ago, our CSE project, officially 

0 titled "Evaluation Uesign:^ An Organizational Study, 11 was funded by NIE 
to look for and study districts that were purposefully using findings 
from externally mandated testing or evaluation efforts in a way that 
influenced their instructional decisionmaking. Hence, the informal 
title of our project— "Li nking^ Testing and Evaluation with Instruction. 11 

From the beginning, we knew from the literature and our own research 
and experience in school districts that district-forged organizational 
links between testing, Evaluation, /and instruction, are not ^ommonplace. 
A number o$ reasons for this nohlinkage have been offered related to 
factors such as the characteristics of mandated tests and evaluations, 
the role or training of evaluators, technical problems with analysis, 
the timeliness of^the reporting cycle. We, ourselves, speculated that 
Some o£ the characteristics of jchools as organizations, might also 
explain the limited use that school "districts make of test and 

•evaluation data. ^ 

School District Characteristics which Might Inhibit Data Use 

Loose coupling . This term refers to the* degree to which the various 
units of any organization are coordinated with and x dependent upo 4 n one - 
another. For example, how likely is it that a decision made by top 
management will be implemented at the lower operational levels? Is the 
coordination among levels tight or loose? Typically, within school . 
districts, the administrative arrangements linking,, board members and 
central administrator with. classroom instructional activities is very 
loose. District-level policy decisions rejating to. instruction may not 
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be routinely Implemeptfetl In tfoe classroom (Qoodlacl* & 'Klein > 1970; Meyer, 

1977). The policy makerS^inten^ may be m$suqderstood; changed, or 

ignored by classroom teachers/ Yhus, for example, district 'administrators 

who want to increase teachers 1 routine 'and systematic use of testing 

a* * i 

. . ^ >' * ** ' 

resul.ts within their own crassrooms-may have to take unusual and non-- - 

ordinary steps to effect such behavior changes.' 

Teacher isolation . Another reason why<cHstrict policy-level deci- 
sions related- to instruction may not be carried out in the classroom is!- 
because teachers often work behind closed; doors isolated from ^ne another 
and from ext ? e$nal supervision. Consequently, it is diffict)lt*for super— * 
visors to influence the teachers 1 . daily activities (Lortie,/ 1975). * 
Districtsthat intend t9 use .evaluation and testing data t9 influence 
teacher decisionmaking will likely have to search for and institutionalize 
ways to overcome teacher isolation. ^ 

Permeable boundaries . School districts 1 orgazational. boundaries 
can and often are breached by external agenci is— witness external regliJ- . 
lations or mandates from the courts or the state and the federal govern 
ment. Local interest groups can often put pressure on school-district 
decision makers. Societal influences such as population shifts, increases 
in immigration, inflation, changing tax structures 1 also affect districts. 
School districts^ therefore, have to continually adjust their activities 
so as*to meet changing and sometimes conflicting demands* and priorities, 

(Pfeffer & Salancik, 1978). Given this boundary permeability, likely 

1 

school districts will have to give attention to federal, state and local 
community interests in and demands for specific types of testing and 
evaluation. data. 
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Goal ambiguity . In our pluralistic society undergoing rapid social 
change, the stated goals of schooling seem to shift rapidly. * Not only 
do the goals change; they are often expressed in ambiguous terms. 
Unlike organizations in the private sector with a profitability '^bottom 
line, 11 public schools must* struggle with the difficulties of measuring 
their successes Hn "developing respQnsible citizens, 11 creating "safe 
drivers," or "students with an appreciation of their historical heritage." 

The students' attainment of these goals is 'often difficult to chart. In 

' \ " * ' . 

summary, there is considerable disagreement in out* society about the 

priorities ancT^standards for students' educational achievements. Factors 

such as these often diminish the utility/of test data as credible measures 

of*a school district's success in educating children/ However, in 

districts where, for example, a community consensus mighty have been 

reached on goals such as achievement, in basic Skills, testing data has 

higher credibility. , 

In view of these generic school district organizational character- 
i sties, it seemed unlikely to us. that most districts would naturally and 
easily integrate testing and evaluation data with instructional decision- 
making. It did seem plausible that,, in some districts, a combination of 
external environmental factory combined with the interests and ^skills of 
particular individuals within the districts might lead to strong admini- 
stratiye 1 inkagesi, among testing, evaluation, and instruction* 
Research Strategy K 

Gur'project began- by^oo king about for a small number of districts ' 
that had a reputation for linking evaluation or testing with instruction, 
Using previous CSE research and extensive telephone interviews with 
colleagues in school districts, state departments of education, other 
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universities, and research institutions, we identified 40 districts that 
were thought to have linked their testing and evaluation activities with 
instructional decisionmaking in some manner. Prom these nominees, a 
jfinal sample of^six districts was^selected. While tjiese districts 
canno.t be viewed as representative of all school districts, they do 
exhibit characteristics that represent the diversity of American school 
districts*, .^g^ di f tenences jLn size (e.g. , large/small},, student demo- 
graphics (e.g. t affluant/below-average income', facially homogeneous/ 
racially heterogeneous), locale (urban/suburban). 

For the past year, we have conducted fieldwork in four of these 
district^ in order to describe the management structures by which test 
and evaluation about students is translated into information that 
has instructional consequences. We analyzed documents and conducted 
over 40 interviews in each district built around three questions: 

1. What ? What kind of linking system do these districts 

K have and how does it work? How mature or fully developed 
^ is the linkage between testing, evaluation, , and instruction? 

2. So what ? Has there been any payoff from these linking 
efforts? Presumably the district linkage system ywas 
developed to accomplish some purpose—what evidemce is 
there that the linking system has had its intended effect? 

3. Why ? If most districts are not trying to link testing 
and .evaluation with instructional decisionmaking, why are 
these districts the exception? In what environment do 
they operate? What was the history of their efforts? 
Were .they planned? Who were the critical actors? What 
? wejp€f^the critical events? 

At present, we have- completedT;h$ first year's work in four districts 

and are sifting through the data in an attempt to identify common properties 
f 
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and consistent patterns. Before sharing our preliminary observations on 
the four districts, we wbuld like to provide a word picture of what the 
Shelter Grove district is doing to link testing data with instructional 
decisionmaking. 

"What" Shelter Grove Is Doing : 

In the Shelter Grove School District, we see a high degree of 
linkage—in conceptualization and in organizational mechanisms— for the 
purpose of individualizing instruction in the basic skills. Teaching is 

closely coordinated with the following: a criterion-referenced testing 

» 

<CRT) system in reading and math; a district continuum in basic skills; 
school-site text and film resource! ; school-site media and learning 
specialists. These instructional functions and individuals are supported 
by a Professional Development Program which provides training in diag- 
nostic and prescriptive teaching for principals, teachers, aides and 
substitutes; by a "definition of the role of the principal as evaluator 
and facilitator of instruction, who must spend 40% of his/her time in 
classrooms. Furthermore, this instructional man' jement orientation is 
reflected in the recruitment, selection, and promotion procedures for 
staff, as well as some principal discretion in local site budgets. 

Interviews with Board members, central office personnel, principals, 
learning specialists and'teachefs revealed* remarkably homogeneous per- 
ceptions about instructional purposes. The president^of the school 
board said, "Almost everyone believes in and works hard at teaching 
individual kids. The kid is the most important thing. We try not to 
have any throwaways." A teacher said, echoing the sentiments of a dozen 
of her colleagues, "This District expects a lot from its teachers; it's 
a great place for kids; they really learn. I moved here so I cbuld sencT 



X3RCW/G 




12 

my own k^ds to' the schools in this District* 11 The Coordinator of mater- 
ials said,- '*We really concentrate on having the children learn—basic 
skills first, as well as <the other important things. The parents would 
not have it any other way. 11 • 

The conceptual connection- between testing and instruction is 
expressed differently by different people 6 in the District. The Super- 
intendent has at management orientation toward instruction. He advocates 
teaching-testing-reteach"ing. "Testing and instruction are intimately, 
related. 11 The Assistant Superintendent is curriculum oriented. She f 
sees testing as the "curriculum in operation." - She emphasizes staff 
development activities for teachers in those curricular areas where 
student deficiencies indicate that teachers should use different teaching 
strategies or devote more instructional time to specific subjects. The 
principals in Shelter Grove see their roles as instructional leaders and 
understand that they at^e required by the District to spend time in each 
cTassrodm. They are familiar with the daily instructional, program, as 
well as with the progress of individual children within their relatively 
small schools. They use the test scores of students to discuss school 
level plans, grade level plans and classroom level plans with teachers. 
"So What?" ' 

In Shelter Grove, the' teaching-testing-training cycle seems to be 
part of teachers 1 daily life in the classroom. They were aware of all 
the operations which were intended by the District to support their 
individualization of instruction. 

All the teachers interviewed knew about the District continuum and 
the CRT system. ' They^ explained the roles of the learning specialist, 
the media specialist, the r principal , and the Professional Development 
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Program 1n terms which were consistent with central, office administrator' 

i i 

i 

intentions. 

For most teachers, the continuum and the related CRT directed their 
selection of what content to teach in the basic skills. This was morr 
true for reading and language arts than math, where the textbook sequence 
.was often followed. Sample quotations: "The continuum is a real working 
tool. 11 11 1 feel comfortable ^about using'it (the continuum). 11 "My teach- 
ing is aimed at it. 11 "I use CRTs in planning. I m^ke a list of areas 
to work in." "I teach to the test and that's OK. 11 For many, it provides 
a well-though-throughway to organize their teaching. * Others like the 
emphasis on skills. "We' teach- -ski-Ms .here in this district. How you do 
it is your business." 

One or two of the teachers we interviewed reacted against the 

centralized control of the' continuum and the CRT system. A teacher 

said, in relation to math, "I don't let the test influence what I do. I 

think the continuum has introduced too much in 'the early grades." A new 

teacher said, "The first year I just waded through. 11 

For most teachers, the CRT scores are useful in grouping children 
f 

and in diagnosing their progress in learning. "Tht CRTs don't provide 

too many surprises." "If I've taught it well, kids pass." The teachers 

♦ 

welcome the diagnostic screening given to new students by the learning 
specialist. It helps place them in groups soon after the start of 
school. Teachers report, that student instructional groups change fre- 
quently based on CRT results. Often they change within classrooms; 
sometimes between classes. The learning specialist facilitates" this 
process by conferencing with teachers after each CRT administration. 

The media specialists report advising the learning specialists and the 

i - 

teachers on specific student-appropriate material. 
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The Professional' Development Program got high marks from teachers. 
They reported that the level one and. level two courses (in objectives 
and in diagnostic/prescriptive teaching) are not duplicates of what they 
had in pre-service courses. ,! PDP makes me aware of what I do. I never 
got this in college." * 

"Why" Shelter Grove is Linking. Testing with Instruction 

fx 

Shelter Grove is" a small elementary^ school district consisting of 
seven elementary schools in which there are 132 teachers, 7 learning 
specialists, 7 principals, and 3,000 children. * 

Shelter Grove seems an ideal community in which to try an -educa- 
tional experiment leading to improved educational excellence for chil- 
dren. The community and the school district have not been beset by many 
of the social problems plaguing other areas in the country. There has 
been no major increase or decrease in population. There exists ho Targe 
group of Children with Engl ish- language difficulties. There exist no 
major political or economic" divisions within the community. The com* 
munity of Shelter Grove is relatively homogeneous. Only 10% of the 
children! going to Shelter Grove schools are minority. 

The adults in Shelter Grove are mostly professionals or work in 
technical occupations. Shelter Grove is a bedroom community serving a 
variety of urban centers located within 50 miles of the community. The 
community has been stable with very few people moving out. The popula- 
tion has been gradually increasing, due to new housing in the area. 

The District is likewise stable. Fifty-five percent of teachers 
have been in the District more than 53 years; 46 percent of principals 
are long-termers. There is a small central office consisting of 5 
professionals and 15 support staff. Eighty percent of these individuals 
have been with the District more than ten years. 
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Within the District, there seems to be general consensus that 
learning is important and that children are important. Although this is 
the rhetoric of most school districts 1 , professionals in Shelter Grove 

_S£emJo_JkejYrilH^ . 

actions require more work, some reorientation in their thinking, some 
readjustment of territories. 

Preliminary Observations on Our Four School Districts 

Environmental context . It is self-evident that school districts 
exist in a social and historical context, as well as within a particular 
community. It is also self-evident, but soruecimes overlooked, that the 
individuals working within school districts and classrooms are parti ci - ^ 
pants in the social and cultural ambience of their times. Additionally 
they are members of their- professional educational communities, simul- 
taneously shaping them and being. shaped by them. > What struck us forcibly 
about our example and the other three^ districts in which we worked was 
the influen that various environmentsxhad upon the district personnel's 
thinking and actions. , 

For example, we were, told repeatedly that the parent populations in 
fhe* four districts were concerned about their children's ability to 1 

1 0 

' * I f 

read, write, and do arithmetic. This emphasis on basic skills was 
translated by teach district in accordance with the professional orien- 
tation of its administrators. In Shelter Grove, the diagnostic/prescrip- 
tive approach reflected the prevailing instructional orientation of the 
two universities from which the principal staff members had received 

their degrees. In another district where their professional training 

«* * * 

had not been so recent, district administrators responded to the com- 
munity's wishes by going districtwide with fundamental schools after 
only a brief year- long voluntary program; 

X3RCW/G „ * 
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One of the striking similarities we noticed among three of our four 

J 

districts was the farge amount of turmoil within which each operated. 
One district was preoccupied with responding to court desegregation 

\ 

^trectives~-wh.i£h^ecessi±^ 



in, the autonomy teachers in minority-isolated schools will have 4 n 
instructional decisionmaking. The^district which was moving quickly to 
transform all of its elementary schbols into fundamental** schools was 
under pressure from a conservative school board representing a community 0 
becoming more "white collar" in composition. A third district was 

* I 1 

struggling with a sudden increase in minority and non-English-speaking 

students who added to an already diverse mix of students. The district 

was investing enormous time. and energy in managing effective instruction 

for minority children with limited-English-speaking capability. 
- . - «-* 

All these district officials were daily inventing solutions to deal ' 

••I 

with these immediate problems; they felt no certainty that solutions or % 
procedures they invented for this year's problems would be appropriate 
Tffr pealing with next year's problems. 

In the fourth district— the example cited above— was these particular 

i • 

societal tensions were not present. However, during the period of our 
research, a'heated unification election has been held. The outcome was, 
causing the district to shift from an elementary school district to a x 

unified K-12 district. 

i 

In each of our four districts, then, there was evidence of what 
might be termed goal diffuseness and boundary permeability. The external 
environment had frequently invaded thp districts 1 boundaries— e.g. , 
court mandates, demands for bilingual programs, population changes, 
unification elections— and forced district administrators to somewhat 
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redirect their energies* Under these circumstances, many district goals 

had been modified* District officials had difficult in maintaining 

_. _ _ 

long-term consistency in ordering their priorities and pursuing their 
goals (March & 01 sen, 1976). Given these external conditions, district 
abilities to develop and implement long-term plans had been severely 
challenged. 

In view of these factors, we felt that it would be surprising if 
testing o'f children for the purppse of evaluating and improving instruc- 
tion was uppermost in the minds of school officials. In the four dist- 
ricts we studied, however, testing and evaluation activities and their 
linkages to instructional improvement were receiving districtwide atten- 
tion, although admittedly," it was *not the first concern of district 
officials. Paradoxically, in all four districts the impetus for use of 
testing and evaluation data seemed to come from the same pressures in 
the environment which made planning difficult. For example, in the 

V 

district moving toward fundamental schools, test scores were being 
considered by the board both as evidence of the effectiveness of the 
revised program and as a monitroing device for teachers 1 use in tracking 
student progress. Shelter Grove's comprehensive criterion-referenced 
testing '(CRT) systeip had been developed in response to'community and 
administrative interests in individualizing instruction for students. 
In our heterogeneous, district, state assessment tests were being analyzed 
Jto see how the curriculum for, various populations matched the specif ica- 
tions of the items. It seems that local environmental forces interacted 
with state and federal requirements to influence district officials to 
take actions linking testing and evaluation with instruction. 

i 

i 

f 
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Personnel . One notable characteristic evident in our four districts 
J*as_ ihs. .professional interest 'key personnel had in instructional improve- 
ment. A second characteristic was the stability of staff. In spite* of 
changes at the Superint^^ntjevel I, Jjie^individuals responsible for 
curriculum, instruction, and supervision of elementary and secondary 
levels had, in each district, worked together over a long period of 

time. In all four districts, these individuals had evolved methods of 

< 

communicating with one another and resolving difficulties., Thjis stability, 
rather than leading to stagnation, seems to have contributed in three of 
the four districts to a sense of direction more coherent than one would 
have though possible given the other organizational and environmental 
instabilities. 

A testing/evaluation/ijistructional subsystem . Although the four 
districts differed from one another in their size,* organization, and 
structure, they each had developed—some more completely than others— a 
.testing, evaluation, ^and instruction (T/E/I) linking subsystem. Such a 
subsystem ~was~ riot a YormaV structure-that-appeared~onJ;he^sjchool v dis- _ 
trict orgazational chart; instead, it was an alignment of individuals or 
departments that had, for a variety of reasons, made informal and formal 
arrangement that enhanced linkage. The subsystem, in some case, consisted 
of two people, in others more, depending on the size of the district and 
the way in which the subsystem was defined. It was not limited to those 



individuals necessarily concerned with testing and evaluation. 
Elements Necessary for Linking Evaluation 
and Testing Data with Instruction 

Three components seemed to be necessary in order for the afore- 
mentioned subsystem to function: ideas, operations, and coordinating 
mechanisms. 
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By idea s,, we« mean those beliefs, goals, assumptions, sometimes 

9 
1 

acknowledged, sometimes not, that guide the district's activities. In 
our four dTsiric^ ideas informed the dist- 

ricts 1 subsystems. In these districts where ideas about testing, evalu- 



ation, instruction, and management were fean r sliic," ac^fate,'aTid^ complete*, 
the subsystem evolved and operated successfully; Where ideas were 
faulty, incompatible with one another, or not fully shared by managers 
the subsystem seemed to falter. In Shelter Grove, the guiding ideas 
shared by most administrators and tea^fchfers were that diagnostic/prescrip- 
tive teaching and testing were needed to ensure individualized instruction. 
By cbntrast, in the district moving toward fundamental schools, ideas 
about how and why to use test data for instructional planning were 
fragmented, imperfectly understood or disputed by many people. 

By operations we mean those individuals, organizational arrangements, 
and technical capacities that enable the district to implement and sus- 
tain the district's ideas. Districts must have high quality personnel 
and the full range of operations in order to manage a T/E/t"* linking sub- 
system* In Shelter Grove, the district wanted to provide test results 
to teachers quickly so as to increase their practical value. They 
therefore needed computer programming skills and afccess to appropriate 
computer facilties to insure that turnaround time would not constitute a 
problem* Likewise, when this district wished teaclWs to take prescrip- 
tive action in relation to diagnostic testing, and it was found that^the 
teachers were not skilled in how to do this, the district provided them 
with appropriate inservice. In this district, both computer operations 
and staff development were considered essential operations for linking 
testing and evaluation with instruction. 

i 
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By u coordinating , mechanisms we mean both formal and informal struc- 
tures and networks that increase communication of ideas, decisions and 

. actio ns. As_we_have noted earlier, school districts have often been 

<? , 

characterized as -loosely. .coupled; that is, communicatioTnTaniJ coordina- 
^iort^ojng._thej^ is often irregular or incomplete. In 

many districts, the curriculum division and school principals, and the ~ 
testing and evaluation unit, are often surprisingly uninformed about 
each others 1 activities and problems. For a T/E/I linking subsystem to 
work it seems necessary that the various operations and individuals who 
manage them be brought" together for communication. and/or decisionmaking 
purposes. In our smail district as an example, this was accomplished 
through somewhat informal means as well as by weeklymeettngs of various 
staffs. In our other districts, coordinating mechanisms took the form 
of reporting relationships, menio writing, etc. 
Summary ^ - 

We have presented some preliminary thoughts about the conditions 
which discourage school districts from linking externally-mandated test- 
ing or evaluation activities with instructional decisionmaking; we have 
also indicated that some few school districts have indeed developed the 
ideas, operations and coordinating mechanisms which permit the linking 
of testing, or evaluation with instruction. During obr second and third- 
year, we will describe more completely those environmental and management 
factors which impede and those which contribute to successful district 
utilization of data from tests and evaluations for locally-initiated 
instructional improvement. 
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Underlying our work are the two basic points we have tried to 
emphasize in this paper: * * 

o The evaluatioii and testing communities must more diligently 

attend to* the characteristics of administrators and teachers 

" - — - ♦ 1 

working within the district environment, if they expect testing 

and evaluation efforts to be used "at the .local level to improve 

■ 

instruction? * — , — 

o The linking of testing and evaluation with instruction does 
not happen within districts, schools and classrooms without 
management, intention and effort. Districtwide subsystems, 
informed by certain ideas and containing a range of related 
operations and a variety of coordinating mechanisms, seem to 
be needed. The search for answers as to why such subsystems 
evolve, how then can operate effectively, and how they can be 
facilitated is worthy of continued attention and support. 
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